Self-organized Criticality and Scale-free Properties in Emergent Functional Neural 

Networks 
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Recent studies on the complex systems have shown that the synchronization of oscillators including 
neuronal ones is faster, stronger, and more efficient in the small-world networks than in the regular or 
the random networks, and many studies are based on the assumption that the brain may utilize the 
small-world and scale-free network structure. We show that the functional structures in the brain 
are self-organized to both the small- world and the scale-free networks by synaptic re-organization by 
the spike timing dependent synaptic plasticity (STDP), which is hardly achieved with conventional 
Hebbian learning rules. We show that the balance between the excitatory and the inhibitory synaptic 
inputs is critical in the formation of the functional structure, which is found to lie in a self-organized 
critical state. 

PACS numbers: 87.18.Bb 87.18. Sn 87.19.La 89.75. Da 89.75.Fb 



The brain is one of the most challenging complex sys- 
tems. The neurons, massively inter-connected to each 
other, show highly complex and correlated responses to 
the external stimuli, which help the brain to extract rele- 
vant patterns from sensory inputs, coordinate movements 
and control behaviors. To understand the complexity of 
the nervous system, we need to characterize its network 
structure on which the spatio-temporal firing activities 
are supported. 

Recent studies on the complex networks in a variety of 
systems describe real networks by simply defining a set 
of nodes and connections between them. Examples range 
over social networks, information networks, technological 
networks, and biological networks^. They lie between 
regular networks and fully random networks. A wide 
variety of such systems are scale-free, where the connec- 
tivity distributions take a power-law form, and the topol- 
ogy and evolution of such networks are governed by the 
common mechanism such as the preferential attachment 
and the growth regardless of the detailed nature of the 
specific networks 
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In the context of the complex network, the topolog- 
ical structure of simple nervous systems, for example, 
in the worm Caenorhabditis elegans neural network|5j, 
have been proved to be an inhomogcncous small-world 
network. However, for the network in the brain, more 
important is the functional structure than the morpho- 
logical one because the former is the direct carrier of the 
neuronal information in the form of spikes. Moreover, 
the functional structure changes through the adaptive 
variation in the synaptic conductances due to the inputs 
from external stimuli and the internal dynamics of neu- 
rons in the network, which in turn leads to the change 
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in the responses of the network. This feedback process 
of synaptic modification in the brain is believed to be 
closely connected to the learning and memory. Recently, 
this kind of synaptic changes have been observed exper- 
imentally in various brain regions, such as neocortical 
slices 0, hippocampal slices 0| and cell cultures 0, and 
the EEL of the electric fish .9], where long term synap- 
tic modifications, both long term potentiation (LTP) and 
long term depression (LTD), arise from repeated pairings 
of pre- and post-synaptic action potentials. The sign and 
the degree of synaptic modification depend on their rel- 
ative timing, called the spike timing dependent plasticity 
(STDP). For example, in the hippocampal CA3 region 
and neocortical slices, by STDP a synapse is strength- 
ened if the presynaptic spike is followed by postsynaptic 
action potentials within about 50ms and weakened if the 
presynaptic action potential follows postsynaptic spikes. 

In this Letter, we report that STDP reorganizes a glob- 
ally connected neural network spontaneously into a func- 
tional network which is both small-world network and 
scale-free. This complex network arises when the exci- 
tatory and inhibitory connection strengths between neu- 
rons are balanced. The neuronal activities on this small- 
world scale-free neural functional network is found to lie 
in a self-organized critical state. The small-world scale- 
free functional structure is formed for a wide class of neu- 
ron models including the Hodgkin-Huxlcy (HH) model, 
which we have also tested and in a wide range of control 
parameters, such as the strength of the external stimulus, 
and parameters related to STDP, independent of the ini- 
tial conditions. The neuronal oscillators in the functional 
structure with a small connection probability organized 
by STDP show fast synchronous responses to the external 
stimuli, which implies that STDP give the neural network 
both the reliability in information transformation and 
the stability preventing from epileptic over-excitation. It 
is noticeable that the functional structure is formed de- 
pending on the spatio-temporal dynamics of the neurons 



FIG. 1: (a) Connection probability, (k/N), in the range between 0.03 (dark) and 0.6 (light), (b) phase coherence, F, between 
0.4 (dark) and 1.0 (light), and (c) the ratio of the clustering coefficient to the case of the random network with the same 
connection probability, C/C ran d, between 0.5 (light) and 7.5 (dark) in the parameter space of G ma x and Gi n h- The results are 
averaged over 10 different initial conditions. 



rather than explicit preferential attachment rule. 

As a model neuron, we take the FitzHugh-Nagumo 
(FHN) model ^(j ! which is a two dimensional relaxation 
oscillator with two time scales but contains the essential 
ingredients of nervous excitation and fast action potential 
generation followed by a slow refractory period: 



cv 
ib 



-Lion i *-syn 

v — w — b 



2* 



(1) 



lion = v(v — a)(l — v) — w, 



where, with e -C 1, v is a fast voltage-like variable, w 
a slow recovery variable, Ii on the ionic current through 
the membrane with cubic nonlinearity, I ex t the external 
current stimulus. The synaptic current input to the z-th 
neuron is the sum of excitatory and inhibitory currents 
from pre-synaptic neurons: 

hyn(t) = [9U<t)(V ~ Vi(t)) + gij(t)(V - Vi(t))] , 

(2) 

where g^ (gij) is the excitatory (inhibitory) synaptic 
conductance from the j-th neuron to the z-th neuron 
and V (V) the excitatory (inhibitory) synaptic rever- 
sal potential respectively. If j-th pre-synaptic neuron 
makes an action potential at time t*, it increases the 
post-synaptic conductances by the amount of the cou- 
pling strength of the synapse at t* normalized by the 
number of neurons, — > g^ + Gy(i*)/(iV — 1) and 
9ij — * 9ij + Gij(t*)/ (N — 1), and the synaptic conduc- 
tances decay exponentially: 
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In our STDP neural network model, we assume that 
inhibitory synaptic coupling strengths remain constant 
@, Gijit) = Ginh, while excitatory synaptic strengths 
change multiplicatively at every firing events PtLIf3.I13| : 



AG*, = G lJ -W(At). 



(4) 



The amount of the synaptic modification by STDP de- 
pending on the time difference between pre- and post- 



synaptic spikes, At = t post 
STDP modification function: 



tn 



is modeled by the 



W(At) 



A + exp(-At/T+) 
-A- exp(At/r_) 



if At > 
if At < 
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and W(At = 0) = 0. The parameters t± determine the 
temporal window of the spike intervals, and A± deter- 
mine the maximum amount of synaptic modification. It 
has been shown experimentally that in most situations, 
A + > t + < t_, and the integral of the function 
W is usually negative^]. Here, the parameter values 
are chosen to be A+ — 0.01, A_ = 0.006, t + = 1.0, and 
t_ = 2.0. Gij lies in < Gy < G max and if Gy increases 
over the maximal value, Gij is set to G max . Other pa- 
rameters are set to a = 0.5, b = 0.12, e = 0.005, V = 0.7, 
V = 0.0, and r syn = f syn = 0.2. 

We start from the globally coupled network of TV = 
1 , 000 neurons with random initial coupling strengths of 
Gij , < Gij < Gmax ■ and investigate how the functional 
structure develops spontaneously in time. Given the ex- 
ternal G?c-current, I ext = 0.2, which is supra-threshold 
stimulus for spontaneous generation of action potentials, 
after a period of relaxation by STDP, some population of 
synapses are strengthened to the maximum conductance 
value, Gmax, while the other population of synapses are 
weakened to near zero and, therefore, become silent to 
their postsynaptic neurons. This is similar to the bi- 
modal distribution in the case of the balanced excitation 
of synapses from many input neurons to a single neu- 
ron [l4||. As a result, even if the neurons in the network 
are morphologically connected all-to-all by synapses, the 
functional structure can be re-organized by STDP in 
which each neuron is functionally connected to only a 
small population of neurons. 

Each synapse is regarded as functionally connected if 
the synaptic conductance is larger than a critical value, 
Gij > G c , and functionally not connected otherwise. In 
Fig^a), the average connection probability, the ratio of 
the number of strengthened synapses to the total number 
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FIG. 2: Log-log plot of degree distributions of the functional structure organized by STDP when the excitatory and the 
inhibitory inputs are balanced. In-degree probability distribution (a), out-degree probability distribution (b), and total-degree 
probability distribution independent of directions (c). The scaling exponents are 7i n ~ 1.7, jout ~ 1.4, and ^ t ot ~ 1-5 in the 
case of Gmax ~ 0.2 and Ginh = 0.02. The results are averaged over 100 runs with different initial conditions. 



of synapses, (k/N), is shown in the parameter space of 
G max and Gi n h- In this figure, there exists a region along 
the diagonal, where the connection probability is very 
small, and on either side of this region the connection 
probability becomes relatively large. In accordance with 
the diagram, three distinct classes of the network states 
can be identified: synchronized, clustering, and dispersed 
network states. To characterize the dynamical properties 
of the functional network organized by STDP, we define 
the phase of a neuron at time t between each firing time 
piece- wise linear lv[l5j: 

m = ^( j~\ +n), (6) 

\ L n+l L n I 

where i* is the n-th firing time of the neuron. The phase 
coherence, T, of neurons in the network is defined as: 




where Ajk(t) is the difference of the instantaneous phases 
of j-th and k-th neurons at time t. Note that T saturates 
to 1 if the firing times of all neurons are coherent with 
n-clusters and if they are random. The dependence 
of the phase coherence, T, in Fig^b) is similar to the 
one for the average connection probability in Fig^a). 
On the lower side of the diagonal, where the excitatory 
input becomes more dominant, all the neurons in the net- 
work fire fully synchronized. On the other hand, in the 
case that the inhibitory input dominates the excitatory 
input, the clustering state is formed where the neurons 
are partially synchronized and each synchronized group 
fires asynchronously. In the diagonal region, the excita- 
tory and inhibitory inputs are balanced, and the firing 
pattern of the network is dispersed but not entirely ran- 
dom. 

To characterize the structural properties of the com- 
plex functional network organized by STDP, we calculate 
the clustering coefficient, C, the fraction of connections 
that actually exist between neighbors of each neurons 



with respect to all allowable connections, and the aver- 
age path length, L, the number of synaptic connections 
in the shortest path between two neurons averaged over 
all pairs of neurons. The phase diagram of the clustering 
coefficient relative to that of the random network with 
the same connection probability, C/C ran d, in Fig^c) is 
similar to those for the average connection probability 
and the phase coherence. In the middle of the diago- 
nal region, the connection probability is very small with 
(k/N) ks 0.03, but the clustering coefficient for our net- 
work is large with C « 0.23, whereas the clustering co- 
efficient of the random network, C ran d ~ 0.03. In this 
region, the average path length is L « 3.19, while for a 
random network L rana - 2.03. These results show that 
the functional structure organized by STDP in the case of 
balanced excitations between the excitatory and the in- 
hibitory coupling has typical small- world characteristics: 
the clustering coefficient of the network is much larger 
than that of random network with the same connection 
probability, C 3> C ran d, and the average path length is 
similar to that of the random network, L ~ L rana -. 

We also find that the degree distributions of the func- 
tional structure of the neural network in the case of the 
balanced input are scale-free. FigI3 shows that the de- 
gree distributions follow a power-law decay with a cut- 
off at large k: Pj„(fc) ~ fc _7i ™, P ou t(k) ~ k~ lout and 
Ptot(k) ~ fc~ 7tot , where P in , P ouU and P tot are the fre- 
quency of nodes with the same number of in-coming, 
out-going and total synaptic connections independent of 
directions, respectively. In the middle of the diagonal re- 
gion in FigQ] the scaling exponents are measured to be 
7i„ ~ 1.7, j ou t ~ 1.4 and j tot ~ 1.5. The estimated val- 
ues of 7 do not depend much on the details of synaptic 
parameters, G max and Gi n h, around the diagonal region. 

After a period of relaxation, the average network prop- 
erties of the functional network remain constant, but 
the synaptic coupling strengths continue to fluctuate as 
the neurons under the supra-threshold stimulus gener- 
ate action potentials spontaneously. Fig|3] shows that 
the distribution of the sizes of the change of the total 
synaptic coupling strength per unit time, D(s), and the 
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FIG. 3: Distribution of the size of the change of the total 
synaptic coupling strengths (a) and the power spectrum of 
the fluctuation of the synaptic strengths (b). Both follows 
a power-law decay with exponents, 7 S ~ 2.5 and 7/ w 2.0. 
The power spectrum has peaks at the natural frequency of 
the FHN neuron and its harmonics. 

low- frequency power spectrum of the fluctuation, P(f), 
power-law decays, D(s) ~ s~ 7a and P(f) ~ l// 7/ , with 
scaling exponents 7 S « 2.5 and 7/ » 2.0. These facts 
suggest that the firing dynamics of the neurons on the 
small-world scale-free functional network lies in a self- 
organized critical state, and the fluctuation is random 
with no time correlation. In this critical state, a slight 
change in synapses may bring a significant change in dy- 



namical firing patterns, which can in turn induce a larger 
change in synapses in an avalanche-like manner as in the 
case of the sandpile models . 

Our results show that by STDP the small-world and 
scale-free functional structure can be spontaneously or- 
ganized in the neural network under common external 
input stimulus, in the form of the self-organized critical 
state. The balance between excitation and inhibition in 
the network dynamics is critical to the formation of the 
nontrivial network structure. The experimental studies 
using fMRI and MEG in human brain sites also show that 
the functional networks in the brain are in fact scale- free 
small- world networks 0, • I n a small- world network, 
due to the large clustering and the short average path 
length, faster and larger synchronization can be achieved 
with only a small number of connections 0, I20I l2l| . 
and the scale-free network is robust against the random 
failure of nodes Q- The functional structure by STDP 
also shows both fast synchronization and high coherence 
which is dynamically effective and structurally robust. 

In the case of conventional Hebbian networks, if the 
common external stimulus is given to a part of a neural 
network, the synaptic connection strengths between the 
neurons under the stimulus increase whereas the other 
synapses are weakened. However, out results suggest 
that even the neurons under common stimulus need not 
be functionally connected, but only a small portion of 
the synapses between neurons can be strengthened to 
make the network sparse but small-world and scale-free. 
We expect that our work would provide insights on the 
studies of the formation of complex networks and the de- 
velopmental process of neural circuits in the brain, as in 
the learning and memory models. We also expect that 
this neural mechanism could be utilized in controlling 
the neural network efficiently and enlarging the memory 
capacity. 
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